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REMOTE INTERPRETATION OF MEDICAL IMAGES 

BACKGROUND 

Pathologists typically use microscopes when diagnosing physiological conditions 
such as cancer, infectious disease and prenatal disorders. Typically, tissue samples on a slide 
5 are loaded onto the microscope, the microscope objective or lens focuses on an area of the 
sample, and the sample is scanned for particular features or objects of interest. In this 
manner, the microscope helps the pathologist to visually determine the presence of abnormal 
numbers or types of cells, organelles, organisms or biological markers. 

Recently, automated microscopes have been integrated into medical imaging systems 

10 that include a variety of networked components. The medical imaging system provides an 
environment for storing and retrieving the medical images produced by the microscopes. 
The components of the medical imaging system are spread throughout the department or 
hospital, or even located remotely, and connected by a communication network. 

An image acquisition device is coupled to the microscope and captures images 

15 produced by the microscope. The image acquisition device can include a variety of 

components. For example, the image acquisition device can include a video camera coupled 
to a high-speed frame grabber for capturing the stream of video produced by the video 
camera and generating a series of digital images. Alternatively, the electronic camera can be 
a megapixel digital camera. The microscope and the image acquisition device can acquire 

20 images for a number of different color planes and at several different focal planes. These 
images can be stitched together to form a two-dimensional or three-dimensional composite 
image. As a result of the combination, and because the images are typically in color and at 
high-resolution, the composite images place significant storage and bandwidth requirements 
on the medical imaging system. For example, a composite image for a single tissue slide can 

25 often exceed a gigabyte in size. 

Image storage and archival devices provide a central library for storing the medical 
images captured by the image acquisition device. Image storage devices include one or more 
databases and image servers for fast access to recently acquired images. Archival devices, 
such as optical disc jukeboxes and tape backup systems, provide long-term storage. When a 



1 



PATENT 

ATTORNEY DOCKET NO.: 10225-023001 

pathologist wishes to view an archived image, the image is automatically "migrated" from 
the corresponding archival device to one of the image storage devices. 

Diagnostic quality view stations display the images captured by the image acquisition 
system. In order to assist the pathologist in interpreting a medical image, a view station is 
5 able to perform a variety of image processing operations on the medical image. For example, 
the pathologist at the view stations may invoke algorithms to perform densitometry on 
selected regions of the medical image in order to identify concentration of a particular 
analyte within the tissue sample. Other image processing operations are useful for finding 
objects within the image such as the nuclei of the cells, computing an integrated optical 
10 density for the nuclei of the cells and reporting the number of molecules per cell. Most 
image processing operations output a fixed number (score), often falling within a 
predetermined range. 

m SUMMARY OF THE INVENTION 

rH 15 In general, the invention facilitates the remote interpretation of medical images. In 

\ % order to facilitate the timely diagnosis of a tissue sample, it is desirable that a medical 

^ professional, such as a pathologist, be able to remotely view and interpret a medical image. 

Q The immense size of a medical image for a single tissue sample typically makes remote 

[SJ viewing unworkable due to bandwidth constraints. Compression algorithms can produce an 

\§ 20 image suitable for transmission, but the data lost during compression can lead to inaccurate 
rj results from the image analysis operations. 

According to one aspect, the invention is directed to a system in which a remote view 
station is communicatively coupled to an image server and receives a compressed version of 
a source medical image. The remote view station uncompresses and displays the received 
25 medical image. The remote view station selects a region of the displayed medical image as a 
function of input received from a medical professional, such as a pathologist. Based on the 
input, the remote view station transmits region information, such as a series of pixel 
coordinates, back to the image server. The image server applies image analysis operations to 
a region of the source medical image that corresponds to the selected region of the 
30 compressed medical image. In this manner, the data loss that occurs during image 

compression does not effect the image analysis operations. As such, the image analysis 
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operations produce more accurate results than if the operations were applied by the remote 
view station on the compressed image. 

In another aspect, the invention is directed to a method for remotely interpreting 
medical images. According to the method, a compressed medical image is generated from a 
source medical image and transmitted from an image server to a remote view station for 
display. In one implementation, the compressed medical image is transmitted over a global 
packet-switched network such as the Internet. A region of the medical image displayed by 
the remote view station is selected in response to input from a medical professional. Region 
information, defining the selected region of the displayed medial image, is transmitted from 
the remote view station back to the image server. Based on the region information, image 
analysis operations are applied to a corresponding region of the source medical image. A 
resulting score is communicated to the remote view station for display. A diagnosis is 
received from the remote view station and associated with the source medical image in a 
database maintained by the image server. 

Various embodiments of the invention are set forth in the accompanying drawings 
and the description below. Other features and advantages of the invention will become 
apparent from the description, the drawings, and the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram providing a high-level illustration of the various 
components of the invention. 

FIG. 2 is a flowchart illustrating one embodiment of a process for remotely 
interpreting medical images. 

FIG. 3 is a block diagram illustrates one embodiment of a computer suitable for 
implementing the various embodiments of the invention. 

DETAILED DESCRIPTION 

Figure 1 is a block diagram illustrating a system 10 that facilitates remotely viewing 
and interpreting medical images. System 10 includes remote view station 26 this is 
communicatively coupled to medical imaging system (MIS) 12 by network 20, which 
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represents any packet-switched network such as a local area network or the Internet. MIS 12 
includes image acquisition devices 14 that represent any medical imaging device that 
generates digital medical images, such as an electronic camera used in conjunction with an 
automated microscope. Other image acquisition devices include computed tomography 

5 (CT), nuclear medicine, magnetic resonance imaging (MRI), ultrasound and X-ray devices. 
Image server 24 stores the images that are generated by image acquisition device 14 and, 
upon request, communicates the images to view stations 16 for display. Using view stations 
16, a medical professional, such as a pathologist, can perform a variety of image processing 
techniques on selected regions to assist in rendering a diagnosis. 

10 As described in detail below, image server 24 of MIS 12 communicates compressed 

medical images to remote view station 26 for interpretation by a medical professional. Using 
a network software application, such as a web browser, the medical professional interacts 
with remote view station 26 to select various regions of interest within the image. Based on 
the selection, image server 24 applies image analysis functions directly to the source medical 

1 5 image stored on image server 24, thereby generating a more accurate score than if applied by 
remote view station 26 to the medical image after compression. The resultant score produced 
by the image processing operations is communicated to remote view station 26 to assist the 
medical professional in interpreting the medical image and rendering a diagnosis. 

Figure 2 is a flow chart illustrating one implementation of a process 28 that facilitates 

20 the interpretation of medical images via remote view station 26. Using a network software 
application the medical professional interacts with remote view station 26, accesses MIS 12 
and receives a list of cases that are marked for review, i.e., cases in which images have been 
acquired by image acquisition devices 14 but have not been reviewed by a medical 
professional (30). Upon reviewing the list displayed by remote view station 26, the medical 

25 professional selects one of the cases for review (32). 

Based on the selection, image server 24 compresses medical images associated with 
the case and communicates the compressed images to remote view station 26 via network 20 
(34). Remote view station 26 decompresses the images and displays the uncompressed 
images for review by the medical professional (36). The displayed image is not a pixel-by- 

30 pixel duplicate of the original source image stored on image server 24 because of data lossed 
during compression. Several algorithms, however, are known that can achieve a 
compression ratio, such that the compressed image uses relatively low bandwidth, without 
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significantly changing the visual representation of the image. Therefore, compressing the 
image can be effectively lossless with respect to human vision. For example, it has been 
found that both JPEG compression and fractal image compression, when set for to moderate 
compression, result in images suitable for transmission without resulting in data loss 

5 perceptible with human vision. 

Using a pointing device, such as a light pen, mouse or track ball, the medical 
professional selects one or more regions of interest. The medical professional can tag a 
region for image processing or can request that image server 24 transmit image data for the 
selected region using a lower compression setting. For example, the medical professional 

1 o can direct image server 24 to transmit an image using low compression or even to transmit an 
uncompressed pixel-by-pixel duplicate of the selected region. Remote view station 26 
encodes the shape and size of the selected region and transmits the region information to MIS 
12 by network 20 (38). The region information defines the boundaries of the selected regions 
and, in one implementation, is a set of pixel coordinates defining the outlines of the selected 

15 regions. As such, the region information typically comprises a small amount information and 
can be quickly transmitted to image server 24. 

If the medical professional requests that image server 24 transmit image data for a 
region of interest using a lower compression setting, or no compression, then image server 24 
extracts the corresponding pixel data from the source image and communicates the pixel data 

20 to remote view station 26 (40). In this fashion, the medical professional can view regions of 
interest at higher resolution, or even a pixel-per-pixel duplicate, without requiring that image 
server 24 transmit the entire source image across network 20. Upon viewing the region of 
interest, the medical professional can tag the region for image processing or can select sub- 
regions of interest. 

25 If the medical professional tags a selected region for image processing, image server 

24 executes the requested image processing operation on the corresponding source medical 
image (42). More specifically, image server 24 analyzes the region information received 
from remote view station 26 and applies the image processing operation to a subset of the 
pixel data of the source image. The subset pixel data is selected based on the boundaries 

30 defined by the region information received from remote view station 26. In this manner, the 
image processing operation produces a more accurate score than if the operation were 
applied by remote view station 26 to the image that has been compressed for transmission 
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and then uncompressed for display at the remote view station. As such, the data loss that 
occurs during compression does not effect the image analysis. 

Image server 24 communicates the scores for each region to remote view station 26 
for display to the medical professional (44). Based on the visual display of the medical 
5 image as well as the scores associated with regions of interest, the medical professional 

interprets the medical image and renders a diagnosis. For example, the medical professional 
may determine that a particular tissue sample is cancerous. Remote view station 26 
communicates the diagnosis to MIS 12 for association with the appropriate case within a 
database maintained by image server 24 (46). 
10 The invention can be implemented in digital electronic circuitry, or in computer 

hardware, firmware, software, or in combinations thereof. Furthermore, the invention can be 
implemented in one or more computer programs that are executable within an operating 
environment of a programmable system embodied and tangibly stored in a machine-readable 
O storage device. 

g 15 Figure 3 illustrates an example of a computer 100 suitable for use as view station 26 

|f in order to implement or perform various embodiments of the invention. As shown in Figure 

y 3, the computer 100 includes a processor 112 that in one embodiment belongs to the 

~ s PENTIUM® family of microprocessors manufactured by the Intel Corporation of Santa 

3 Clara, California. However, computer 100 can be implemented on computers based upon 

!j 20 other microprocessors, such as the MIPS® family of microprocessors from the Silicon 
Z Graphics Corporation, the POWERPC® family of microprocessors from both the Motorola 

3 Corporation and the IBM Corporation, the PRECISION ARCHITECTURE® family of 

microprocessors from the Hewlett-Packard Company, the SPARC® family of 
microprocessors from the Sun Microsystems Corporation, or the ALPHA® family of 
25 microprocessors from the Compaq Computer Corporation. 

Computer 100 includes system memory 113, including read only memory (ROM) 114 
and random access memory (RAM) 115, which is connected to the processor 1 12 by a 
system data/address bus 116. ROM 114 represents any device that is primarily read-only 
including electrically erasable programmable read-only memory (EEPROM), flash memory, 
30 etc. RAM 115 represents any random access memory such as Synchronous Dynamic 
Random Access Memory. 



6 



PATENT 

ATTORNEY DOCKET NO.: 10225-023001 

Within the computer 100, input/output bus 1 18 is connected to the data/address bus 
1 16 via bus controller 1 19. In one embodiment, input/output bus 1 18 is implemented as a 
standard Peripheral Component Interconnect (PCI) bus. The bus controller 119 examines all 
signals from the processor 1 12 to route the signals to the appropriate bus. Signals between 
5 the processor 1 12 and the system memory 1 13 are merely passed through the bus controller 

119. However, signals from the processor 112 intended for devices other than system 
memory 1 13 are routed onto the input/output bus 118. 

Various devices are connected to the input/output bus 118 including hard disk drive 

120, floppy drive 121 that is used to read floppy disk 151, and optical drive 122, such as a 
10 CD-ROM drive that is used to read an optical disk 152. The video display 124 or other kind 

of display device is connected to the input/output bus 1 18 via a video adapter 125 and 
preferably is a high-resolution display suitable for viewing medical images. Computer 100 
also includes a modem 129 and network interface 53 for communicating over network 20 via 
either a wired or wireless connection. 

15 A medical professional enter commands and information into the computer 100 by 

using a keyboard 140 and/or pointing device, such as a mouse 142, which are connected to 
bus 1 18 via input/output ports 128. Other types of pointing devices (not shown in Figure 1) 
include track pads, track balls, joysticks, data gloves, head trackers, and other devices 
suitable for positioning a cursor on the video display 124. 

20 Software applications 136 and data are typically stored via one of the memory storage 

devices, which may include the hard disk 120, floppy disk 151, CD-ROM 152 and are copied 
to RAM 115 for execution. Operating system 135 executes software applications 136 and 
carries out instructions issued by the user. The Basic Input/Output System (BIOS) 1 17 for the 
computer 100 is stored in ROM 1 14 and is loaded into RAM 115 upon booting. BIOS 1 17 is 

25 a set of basic executable routines that help transfer information between the computing 
resources within the computer 100. 

This application is intended to cover any adaptation or variation of the present 
invention. It is intended that this invention be limited only by the claims and equivalents 
thereof. 

30 
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What is claimed is: 

1 . A method comprising: 

generating a compressed medical image from a source medical image; 
transmitting the compressed medical image to a remote view station for 
5 display; 

selecting a region of the displayed medical image; and 
applying image analysis operations to a region of the source medical image 
corresponding to the selected region of the compressed medical image. 

10 2. The method of claim 1 wherein transmitting the compressed medical image includes 
transmitting the compressed medical image over a global packet-switched network. 

3. The method of claim 1 and further including transmitting region information from the 
remote view station to an image server, wherein the region information defines the 

1 5 selected region of the displayed medial image. 

4. The method of claim 3, wherein the region information is a series of pixel 
coordinates. 

20 5. The method of claim 1, wherein applying the image analysis operations includes 
outputting a score and communicating the score to the remote view station for 
display. 

6. The method of claim 1 and further including receiving a diagnosis from the remote 
25 view station and associating the diagnosis with the source medical image in a 

database. 

7. The method of claim 1 , wherein selecting the region of the compressed medical 
image includes receiving input from a pointing device controlled by a user to outline 

30 the region of the compressed medical image. 
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The method of claim 1, wherein generating a compressed medical image includes 
applying a compression algorithm that reduces data losses that are detectable with 
human vision. 

The method of claim 8, wherein generating a compressed medical image includes 
applying a JPEG compression algorithm. 

A system comprising 

an image server storing a source medical image; 

a remote view station communicatively coupled to the image server to receive 
a compressed version of the source medical image, wherein the remote view station 
includes an input device for selecting a region of the compressed medical image, and 
further wherein the image server applies an image analysis operation on a region of 
the source medical image that corresponds to the selected region of the compressed 
medical image. 

The system of claim 10, wherein the remote view station transmits region information 
from the remote view station to the image server, wherein the region information 
includes a plurality of pixel coordinates outlining the selected region of the 
compressed image. 

The system of claim 10, wherein the image server applies the image analysis 
operations to generate a score and communicates the score to the remote view station 
for display. 

The system of claim 10, wherein the image server includes a database associating a 
diagnosis received from the remote view station with the source medical image. 

The system of claim 10, wherein the remote view station includes a pointing device 
controllable by a user to outline the region of the compressed medical image. 
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15. A computer program, tangibly stored on a computer-readable medium, comprising 
instructions operable to cause a programmable processor to: 

generate a compressed medical image from a source medical image; 
transmit the compressed medical image to a remote view station for display; 
5 receive region information from the remote view station, wherein the region 

information defines a region within the compressed medical image; and 

apply image analysis operations to a region of the source medical image as a 
function of the region information. 

10 16. The computer program of claim 1 5 and further including instructions to cause the 
processor to transmit the compressed medical image over a global packet-switched 
network. 

1 7. The computer program of claim 1 5 wherein the region information is a series of pixel 
15 coordinates. 

18. The computer program of claim 15 and further including instructions to cause the 
processor to output a score and communicating the score to the remote view station 
for display 

20 

19. The computer program of claim 15 and further including instructions to receive a 
diagnosis from the remote view station and associate the diagnosis with the source 
medical image in a database. 

25 20. The computer program of claim 15 and further including instructions to apply a 

compression algorithm that reduces data losses that are detectable with human vision. 

21 . A computer-readable medium having a data structure stored thereon comprising: 
a data field identifying a source medical image; 
30 a data field identifying a compressed version of the source medical image; and 

a data field storing an output score from an image analysis operation applied 
to a region of the source medical image. 

10 
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22. The computer-readable medium of claim 2 1 , wherein the data structure includes a 
data field associating a diagnosis with the source the medical image. 



5 23 . A method comprising: 

compressing a source medical image at a compression level; 
transmitting the compressed medical image to a remote view station for 
display; 

receiving region information from the remote view station, wherein the region 
10 information defines a region of the compressed medical image; and 

compressing a region of the source medical image at a second compression 
level as a function of the region information. 



24. The method of claim 22 wherein transmitting the compressed medical image includes 
1 5 transmitting the compressed medical image over a global packet-switched network. 

25. The method of claim 23, wherein the region information is a series of pixel 
coordinates. 



20 26. The method of claim 23 and further including receiving a diagnosis from the remote 
view station and associating the diagnosis with the source medical image in a 
database. 



27. A method comprising: 

25 transmitting a medical image to a remote view station for display; 

receiving region information from the remote view station, wherein the region 
information defines a region of the displayed medical image; and 

locally applying an image processing operation at the image server to a region 
of the source medical image as a function of the region information. 

30 

28. The method of claim 27 wherein transmitting the medical image includes transmitting 
the medical image over a global packet-switched network. 

11 
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The method of claim 27, wherein the region information is a series of pixel 
coordinates. 

The method of claim 27, wherein transmitting the medical image includes 
compressing medical image. 
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REMOTE INTERPRETATION OF MEDICAL IMAGES 

ABSTRACT OF THE DISCLOSURE 

A remote view station is communicatively coupled to an image server and receives a 
compressed version of source medical images. The remote view station uncompresses and 

5 displays the received medical image. A medical professional, such as a pathologist, can 

select a region of the displayed medical image. Region information is transmitted back to the 
image server that applies image analysis operations on a region of the source medical image 
that corresponds to the selected region of the compressed medical image. In this manner, the 
data loss that occurs during image compression does not effect the image analysis operations. 

10 As such, the image analysis operations produce more accurate results than if the operations 
were applied by remote view station to the uncompressed image. 
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